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<g) A method for detecting edge direction In an Interlaced television image 



@ The invention relates to a method for detecting 
an edge and edge direction in an interlaced video 
signal received In the form of a sampled data. In a 
detection mask it is calculated the responses of 
several operators with respect to the examined posi- 
tion PQ in the center of the mask, which function in 
different subdirections. The responses are arranged 
In main groups according to the main directions, and 
for each main group it is found out a minimum 
response and its subdirection, after which it is found 
out the minimum of the minimum responses. In 



addition, for the examined position (X) it is deter- 
mined Its activity. The operators also Include a hori- 
zontal operator. In a consistency check it is found 
out the dominant main direction for the edge using 
the main and subdirection Information of the exam- 
ined position (X) and its neighbouring positions, 
stored in memory, and the subdirection of the mini- 
mum response of said main direction group of the 
examined position is selected as the final edge di- 
rection. 



CM 
< 



1^ 
00 
CO 



CL 
Ul 




Rank Xerox (UK) Business Sen/ices 

(3.10/3.09/3.3.4) 



BNSDOCID: <EP ,06871 04A2J_> 



1 



EP 0 687 104 A2 



2 



The invention relates to a method for detecting 
and encoding edges in an interlaced video signal. 
In the edge detection it Is employed a window in 
which operator responses are calculated in several 
directions. 

When processing a received interlaced video 
signal digitalized into sampled data, the image pro- 
cessing application used is in most cases interpola- 
tion, peaking, noise suppression, or motion estima- 
tion. To obtain good results it is needed in any of 
these applications knowledge about the edge direc- 
tion in the image; In other words, it is needed an 
edge detection method. Edge detection is of ut- 
most importance in object detection. When one 
looks at an object one perceives it by looking at its 
edges and angles and their jaggedness and sharp- 
ness. Therefore, in image processing, it is impor- 
tant to identify the local image contents and pro- 
cess the image accordingly. Jaggedness. line 
breaking, and unsharpness of edge regions as well 
as blurring of details in the image, which are typical 
of known methods especially when using a fixed 
algorithm, are highly dependent of the direction of 
the edge region. Hence, the purpose of edge de- 
tection is to examine which is the correct interpola- 
tion direction, sharpening direction, etc. To find that 
out, one has to obtain reliable edge information 
about the surroundings of the pixel to be pro- 
cessed. When the direction has been found out, it 
is possible to choose a processing method suitable 
for that direction. 

For example, edge adaptive interpolation can 
be used to convert an interlaced normal definition 
image (720*576/50/2:1) either to a non-interlaced 
image (720*576/50/1:1), an image with a doubled 
field frequency (720*576/100/2:1), or to an image 
with a doubled vertical and horizontal line rate 
(1440*1152/50/2:1). In all these conversions it is 
possible to use the same edge detection method. 

Finnish patent FI-89995 presents an efficient 
edge detector operating in a 6*3 window, capable 
of detecting an edge in nine directions. The detec- 
tion takes place inside a field. Figure 1 shows a 6*3 
window used in the detection which comprises 6 
adjacent pixels c1 , c2. c3, c4. c6 and c6 on the line 
m-1 and, likewise, 6 adjacent pixels c7. c8, c9, clO, 
c11 and c12 on the next line m + 1 of the same 
field t. By means of the pixels on these lines it has 
- to be calculated the value,~marked with a question 
mark (?), of the edge estimate of the pixel on the 
line interpolated in between. Figures 2a...i show 
possible edge line directions and the pixel pairs 
taken into account in the calculation in each case. 
In Figure 2a It is examined whether the edge line Is 
at an angle of 90 degrees; in Figures b, d, f and h, 
whether the line is inclined to the left in the direc- 
tion of 116, 135, 146 and 154 degrees, and in 
Figures c, e, g and i, whether the line is inclined to 



the right in the direction of 26. 34. 45 and 64 
degrees. These nine different cases are divided 
into three groups to be examined: the middle group 
Rk including the following directions to be exam- 

5 ined: 64, 90 and 116 degrees (Rgures a, b and c); 
the right group Ro including the following directions 
to be examined: 26, 34 and 45 degrees (Figures e, 
g and i); and the left group Rv including the follow- 
ing directions to be examined: 135, 146 and 154 

70 degrees (Figures d, f and h). Each possible edge 
direction is examined by calculating with four pixels 
the sum of the absolute differences of the pixels. In 
Figure 2, the arrowheads at the ends of the con- 
tinuous lines indicate the positions of the pixel 

75 pairs included in the calculation of the difference in 
each case. First, it Is calculated a response for 
each edge direction as follows: 

middle group Rk: 

20 

vertical = | c3 - c9 | + | c4 - clO | 
rightl = | c3 - c8 | + | c4 - c9 j 
lefti = |c2-c9| + |c3-c10| 

25 



left group : 

30 

Ieft2= |c2-c10| + |c3-c11 j 
Ieft3 = |c1 - c10| + |c2-c11 I 
Ieft4 = |c1 -c11 I + |c2-c12| 

35 

right group : 

40 right2 = | c4 - c8 | + j c5 - c9 j 

rights = j c4 - c7 | + | c5 - c8 | 
right4 = | c5 - c7 1 + | c6 - c8 1 

After all responses In 9 directions have been cal- 
45 culated group by group, it is found out the mini- 
mum response for each group. When the minimum 
response of each group has been found out, it is 
found out the smallest of the minimum values, the 
minimum" of "the TninimumsT which" will be marked" 
50 TOTmin. 

When it has been calculated in the window of 
Figure 1 , using the above formulas, in each group 
the value and direction of the group minimum and 
found out which group contains the TOTmin, these 
55 data are stored in memory as an estimate. So the 
value of the estimate of the pixel represented by a 
question mark consists of four pieces of informa- 
tion: 
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1) the direction of the minimum response of 
group Ro, 

2) the direction of the minimum response of 
group Rv, 

3) the direction of the minimum response of 5 
group Rk, 

4) TOTmin, which indicates which group's mini- 
mum response is the smallest. 

By sliding the window it is calculated the es- 
timate for the pixel on the right side of the pixel io 
marked with a question mark, then the estimates 
for the pixels of the line to be Interpolated next, 
until a sufficient amount of edge information from 
the neighbourhood of the interpolated pixel marked 
with a question mark has been stored in memory. 75 
On the basis of this edge information, ie. these 
estimates, it is next selected the final edge in- 
formation in the edge information correctness 
checking circuit, which, by comparing the edge 
information to the edge information of the neigh- 20 
bouring pixels and using a suitable consistency 
check, decides whether the edge information is 
acceptable. After that, the Image may be further 
processed in the direction indicated by the edge 
information. 25 

The edge detection method described above, 
like other corresponding methods, is based on the 
assumption that the deviation of luminance values 
is low along an edge whereas across an edge the 
deviation is high. The deviation is measured as an 30 
absolute difference of luminance values. The edge 
information is obtained by calculating the absolute 
differences In the various directions and selecting 
the direction with the smallest response as edge 
direction. If edge detection is carried out in a noisy 35 
location or close to narrow lines, it is possible to 
obtain small responses In several directions, in 
which case it Is difficult to find out the correct 
direction- it is a disadvantage of the method de- 
scribed above that it does not provide information 40 
about whether or not a certain point is an edge 
point, and another disadvantage is that it is not 
capable of detecting a horizontal edge. Therefore, 
detemnining the edge direction by examining a 
single location does not provide an entirely reliable 45 
picture of the edge direction. 

It is an object of this invention to find an edge 
detection method which has the advantages of the 
method described above but which also makes it 
possible to detect the orientation of an edge in the so 
horizontal direction. This goal Is achieved accord- 
ing to the enclosed claims as follows: it is found 
out in the neighbourhood of the location examined 
the dominant edge direction. Then it Is assigned a 
few direction candidates for each examined posi- 65 
tion in the field, and then the number of incorrect 
candidates Is reduced on the basis of a suitable 
criterion in order to increase the probability for the 



correct direction. The probability is increased by 

• using parallel difference calculation in each 
direction, 

• processing various directions hierarchically 
by dividing the directions into main directions 
and subdirections 

• calculating trial interpolation values and dis- 
carding one main direction that does not fit 
into Its neighbourhood, and 

• selecting the dominant direction in a neigh- 
bourhood. 

The invention is described in more detail with 
reference to the enclosed diagrammatic drawings, 
where 
Figure 1 

is an edge detection mask in a known method, 
Rgure 2 

illustrates operators in a known method. 
Figure 3a 

shows an edge detection mask in the method of 
the invention 
Figure 3b 

illustrates the memory arrangements in the for- 
ming of the mask of Figure 3a 
Figure 4 

shows direction operators. 
Figure 5 

is a coupling arrangement for calculating re- 
sponses, 
Figure 6 

is a coupling arrangement for calculating pre- 
liminary direction information 
Figure 7 

illustrates the memory arrangement used in the 
consistency check. 
Figures 8a and 8b 

show the coupling for the use of direction in- 
formation for determining the interpolation direc- 
tion, and 
Figure 9 

shows a coupling for improving consistency. 
Rgure 3a shows a window used in the detec- 
tion. In this example, the window is the size of 7^3 
but any n*3 window can be used. The top row of 
the window consists of 7 adjacent pixels c1 . c2, c3. 
c4, c5. c6 and c7 from the line m-1 and, likewise, 7 
adjacent pixels c8, c9. clO. c11, c12. c13 and c14 
from the next line m + 1 of the same field t. Using 
the pixels of these lines it has to be calculated the 
value of the edge estimate, marked with X. This 
estimate can be thought of as e.g. the edge in- 
formation of the pixel on the line interpolated in 
between. 

Since the calculation of the direction estimate 

Is an intra-field process, It uses only pixels c1 

c14 of field t, in other words, the top and bottom 
row of the window are used. In practice, it is 
performed simultaneously with the edge detection 
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the creation of new sannples according to the edge 
information, If the algorithm exploiting the edge 
detection, say, Interpolation, is an inter-field pro- 
cess, then pixels p3, p4 and p5 are also brought 
into the window from the preceding field t-1 . Let it 5 
be pointed out that these pixels are not used in the 
edge detection itself, but the edge detection is 
purely an intra-field process- 
Figure 3b illustrates the memory arrangement 
for the forming of the calculation window. It is io 
intended for a case where the video signal com- 
plies to the PAL system and the active sample 
space is 720*576. If the number of digitized sam- 
ples differs from the above, the size of the line and 
field memories is of course different. The arrange- 75 
ment simply comprises successive pixel memories 
c1, c2, c3, c4, c5, c6, c7 and c8, c9, clO, c11. cl2, 
c13 and c14, and a delay between these two 
groups of seven pixels, which corresponds to the 
line duration minus the width of the window, or in 20 
this case delayed for 713 pixel delays. The delay is 
mariced 713*D. The top and bottom rows of the 
window are obtained from the outputs of the pixel 
memories. Then follows the field memory (286LM) 
consisting of 286 line delays. If the line of the 25 
preceding field in the window is even-numbered, It 
is obtained from the output of the field memory 
delayed by the time that corresponds to 715 pixel 
memories (715*D), and if it is odd. it is obtained 
from the output of the field memory delayed by 30 
one line and In said 71 5 pixel memories. Selection 
is performed with a controlled switch as shown in 
the figure. The samples of the middle row in the 
window, le. those of the preceding field, are ob- 
tained from the outputs of pixel memories p5, p4 35 
and p3. On the basis of the figure, the forming of 
the window is clear to a person skilled in the art. 
The video signal samples arrive in block CI 4, 
travel through all successive memories and leave 
at pixel memory p3, which thus yields the tern- 40 
porally oldest sample. Let it be pointed out that the 
samples p3, p4 and p5 of the preceding field are 
needed only if the image is converted from normal 
definition raster to high definition raster or from 
interlaced to progressive (IPC). In the latter case, 45 
the conversion is done so that the intermediate 
sample for the 3-point median filter is taken from 
the preceding field. Therefore it is needed a field 
~memory^lf~the~conversion were~field~rate~~upcon- 
version (FRU), then it would be needed two field 50 
memories. In the edge direction estimation it suf- 
fices to have the pixel memories and one line 
memory between them. 

For each examined sample X in a field It is 
calculated a local direction using nine direction 55 
operators inside the window, shown in Figures 
4a.. .4i. In each Figure there are two arrows next to 
each other. For both arrows, it Is first calculated the 



difference of the absolute values of the current 
pixels Indicated by the arrowheads in the window, 
and then the sum of the differences. This is done 
in all nine directions. E.g. in Figure 4a marked Ieft4 
(154*) the marking Ieft4 means that this is the 
fourth operator m the group where there are 4 
operator pairs inclined to the left, and the degree 
shows the amount of inclinafion. In this figure, the 
sum of the absolute differences, le. the operator 
response Ieft4 is | c1-c12 j + | c2-c13 | . The sum 
of the absolute differences Is calculated in the 
same manner in all nine directions and the sums 
are stored In memories for further processing. The 
operators are divided into three groups: the left 
group comprising operators Ieft2, Ieft3 and Ieft4; 
the middle group comprising operators rightl , verti- 
cal and lefti; and the right group comprising oper- 
ators right2, rights and right4. The mathematical 
expressions for the sums of the differences In ail 
directions, divided into groups mentioned above, 
are as follows: 

middle group: 



vertical = | c3 - c1 0 | + | c4 - c1 1 
rightl = | c4 - clO | + | c5 - c11 | 
lefti = |c3-c11 I + |c4-c12| 



left group : 



Ieft2 = |c2-c11 I + |c3-c12| 
Ieft3 = I c2 - c12 I + I c3 - cl3 I 
Ieft4 = |c1 -c12| + |c2-c13| 



right group : 



right2 = [ c5 - clO | + j c6 - c11 | 
rights = j c5 - c9 | + | c6 - clO | 
right4 = I c6 - c9 I + I c7 - clO I 

In addition to these nine directions, it is calculated 
Ihe response for the horizontal direction operator 
as follows: 

horizontal = | c4 - c11 | - range(c3, c4, c5) - range- 
(dO, cl1, c12), where "range" means the dif- 
ference of the maximum and minimum of the input 
samples. 

The horizontal direction response is based on 
the same assumption that is used for the other 
directions: the deviation of sample values Is low 
along an edge whereas across an edge the de- 
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viation is high. Thus, It is calculated maximum(c3, 
c4, c5) - minimunn(c3, c4, c5) and maximum(c10. 
c11, Gl2) - minimum(c10, c11, c12). The sum of 
these two is then subtracted from the absolute 
difference of the two vertically aligned samples c4, 
c11, thus yielding the horizontal response as a 
result. Therefore, the greater the vertical difference 
and the smaller the horizontal difference, the great- 
er the horizontal response and, thus, the probability 
for there being a horizontal edge in that location of 
the image. This information can be used in further 
processing of the image, e.g. by forcing the Inter- 
polation horizontal instead of directions, say, Ieft4 
or right4. This is especially beneficial with images 
containing text, where extreme directions (horizon- 
tal/vertical) tend to deteriorate the signal. By setting 
a high enough threshold for the horizontal operator 
it can be made more certain that there really is a 
horizontal edge. 

Of course, the horizontal operator may be dif- 
ferent from the one described above. The essential 
thing is that it is based on the comparison of 
responses of vertical and horizontal directions. 

The above-mentioned responses in nine direc- 
tions and the horizontal response are calculated 
with a coupling arrangement shown in Figure 5. Its 
inputs are the samples c1. c13 of the top and 
bottom rows of the window. Block A comprises 
calculation means to calculate eighteen absolute 
differences simultaneously and to sum the sums of 
the differences in pairs. Inside each calculation part 
there is marked the calculating operation it per- 
forms. The operator responses are obtained from 
the output of block A. The horizontal operator re- 
sponse is calculated in block B. The groups of 
three samples c3, c4, c5 and c10, c11, c12 are 
arranged in the order of magnitude of the samples 
In the sorting blocks and the differences of maxi- 
mum and minimum of the sample values of the 
blocks are calculated and then summed and the 
sign of the sum is changed to the opposite. The 
difference of the sample values c4-c1 1 is added to 
the negative sum and the result is thresholded with 
the number k1 , thus yielding the horizontal operator 
response. The threshold value can be freely se- 
lected, a suitable value could be kl = 128. 

When selecting the final edge direction in the 
consistency check discussed later, it has proved 
advantageous to perform this check adaptive to the 
number of relevant edge information. This means 
that when determining the final edge direction, it is 
only considered the edge information associated 
with the active positions. Activity is determined on 
the basis of the middle group information so that if 
at least one response in this group is greater than 
the set threshold value k2. which could be e.g. 16. 
then the image position is active and the direction 
information will be taken into account in the consis- 



tency check. The check is performed in a simple 
manner in block C with an OR operator having as 
its inputs the thresholded responses of the middle 
group. The activity information "active/inactive" is 
5 obtained from the output. Hence, if any one of the 
middle group responses fed to the input exceeds 
the set threshold value k2, the position in question 
is considered "active". 

The activity check can also be done in a way 
10 different from the one described above. For exam- 
ple, it is possible to examine the absolute dif- 
ference of two samples or the difference of the 
maximum and minimum in a group of three sam- 
ples. Then the position is considered active if 
75 abs(c4-cl 1 ) > k2, or 

[max(c3.c4,c5) - min{c3.c4,c5)] > k2, or 
[max(c10,c11.c12) - min(c10.c11,c12)] > k2 
k2 is a selectable threshold value which could be 
1 6, for example. 
20 As the responses, activity, and thresholded 

horizontal response have been calculated, they are 
ready to be stored in memory. The responses are 
further processed according to Figure 6 both in the 
main and subdirections so that the responses Ieft2. 
25 Ieft3 and Ieft4 of the left group comprise the left 
main direction, the responses Ieft1, vertical and 
rightlof middle group Rk comprise the middle main 
direction, and the responses right2, rights and 
right4 of the right group comprise the right main 
30 direction. The responses of each main direction are 
taken to the appropriate block MIN, which finds out 
the minimum response among the input responses. 
Thus it is obtained the minimum responses and 
their directions ( = one of the three subdirections of 
35 a main direction) in each main direction. Before 
sorting in the blocks MIN the input responses have 
to be labelled somehow so that they can be distin- 
guished after the sorting. The responses can be 
labelled e.g. in the following manner: it is reserved 
40 a three-bit field for each main direction and bit "1" 
is used to indicate the subdirection. 

After the operations performed in blocks MIN 
both the minimum response and the corresponding 
subdirection are available for each main direction; 
45 in Figure 6 e.g. resp_left and dir__left denote the 
minimum response and corresponding subdirection 
in the left main direction. Resp_ieft could be e.g. 
the response (numerical value) of the operator 

Ieft3, in which case dir left would be 146*. The 

50 other blocks have corresponding markings. 

When the minimum responses and corre- 
sponding subdirections have been calculated, it is 
next found out which of them are unsuitable. There 
are several ways to determine and mark unsuitable 
55 directions. In this invention it is used two separate 
check routines which will be called Check A and 
Check B. Still referring to Figure 6. 
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In the Check A block it Is taken two successive 
operator responses Inrimediately to the right and to 
the left of the vertical direction, ie. response pairs 
rightl, right2 and lefti, Ieft2. The response pairs 
are summed and the sums of the pairs are com- 
pared in the comparison block 52, which deter- 
mines the probable/improbable main directions. If 
(Ieft2 + lefti) > (rightl + right2), ie. the sum of the 
response pair of the right direction is smaller, then 
the probability of the edge direction is greater in 
the right direction. The block output is then 1 and 
the discarding of the more improbable left main 
direction is done by adding a certain large con- 
stant, say, 256, to the corresponding minimum 
response resp__left, thus making the minimum re- 
sponse large and preventing it from proceeding to 
the interpolation, which occurs later. The prevent- 
ing is done as follows: output 1 of the comparison 
block 52 is taken to a multiplier m1 . the other input 
of which is the value 256. Then the output of the 
multiplier is 256, which will be summed with the 
minimum response of the left direction. The mini- 
mum response of the right direction remains un- 
changed since said value 1 is inverted before the 
multiplier m2. If the comparison block outputs a 
"0", the process is inverse to the above. So, Check 
A always manipulates the minimum response either 
in the left or in the right direction and makes it 
useless by changing its value into the biggest 
possible. 

After block A, we have the minimum responses 
in all three main directions and, in addition, the 
subdirection information is associated to the mini- 
mum response. The response direction information 
from the left and right groups, ie. the direction 
information dir__left and dir__right are stored in 
memory 51 as is also the information on the cor- 
rectness probability of these directions calculated 
in the comparison block 52. 

Then it is perfomned a trial interpolation in 
block B (Check B), using the subdirections 
(dir_left or dir_right) stored in memory 51 and 
calculated In connection with the search for the 
minimum response of the right and the left main 
direction. This stage requires precalculated inter- 
polation values for at least the left and the right 
group. In practice, however, it is the most straight- 
forward method to calculate all possible values and 
-~ store them in the memory 51" (9-memory locations) " 
and then select one of them by means of three 
control signals: the subdirections dir_left, dir__right 
mentioned above and the one of those two that 
was used. Then the trial interpolation value y is 
compared to the sample c4 above and sample c1 1 
below the zero sample X. This is done by calculat- 
ing the difference of these samples and the trial 
value y. If the difference falls outside a preset 
range, in our example the range [-32,32], the re- 



maining extreme main direction (dir_left or 

dlr right) is considered definitely wrong and, 

therefore, it is discarded by adding the value 256 
to its response. It is necessary to add this value 

5 only to the remaining extreme main direction, but it 
can be added to both of the extreme responses, as 
shown in Figure 6. The check described above is 
done in sub-block D with simple AND and OR 
operations. Of course, it is possible to implement 

io block D in other ways, too, and yet obtain the same 
result. 

The next stage is to find the smallest of the 
main direction minimum responses (dir__totmin). 
The search Is done in block 53 (Figure 6), where 

75 the minimum responses rasp left. resp_right and 

resp middle of the three main directions, which 

are the block's inputs, are arranged in the order of 
magnitude, and the smallest of them, marked with 
is chosen for the output. It can be 

20 marked with a three-bit code word. 

Block E is optional. If the angle is e.g. between 
45* and 64*. ie. between two groups (middle and 
right), there will appear a small "coupling error" In 
the image. Therefore, it is possible to add block E 

25 producing "intermediate groups" right^middle and 
left_mlddle. These operate m connection with the 
search for dominant direction in a way correspond- 
ing to that of the main groups. By means of AND 
and OR operations performed in block E it is 

30 examined whether dir_totmin belongs to the inter- 
mediate groups or not. The AND operation com- 
pares the dlr ^totmin value to the dir right, 

dir middle and dir left values, Ie. the following 

logic AND operations are performed: 

35 (a) dir_totmin AND dir_right 

(b) dir_totmin AND dir__middle 

(c) dir_totmin AND dir_left. 

After that, in the OR operations it is performed (a) 
OR (b), the result of which is right__middle, and (c) 

40 OR (b), the result of which is left^middle. The 
result right_middle or left_middle is "1" if the 
minimum response of the group left_mlddle is 
lefti or Ieft2 or. correspondingly, if the minimum 
response of the group right middle is rightl or 

45 right2. In other words, if the value of the 
right_middle bit is "1 ", it means that either rightl 
or right2 gives the minimum response in the whole 
lot After this phase, the responses are no longer 
heeded.' With the measures taken so far it has 

50 been found out 

a) in which of the three main groups the ab- 
solute minimum response (= dlr ^totmin) Is, 

b) in which direction the minimum response { = 
dlr left dir middle, dir right) of each main 

55 group is, and 

c) the optional information (left middle) about 

whether the absolute minimum response is in 
the direction of the groups lefti and Ieft2, and 
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the optional Information (right middle) about 

whether the absolute minimum response Is in 
the direction of the groups rightl and rlght2. 
All this Information is stored in memory for the 
consistency check. The memory may be a 16-bit 
memory unit 54. Also the activity information cal- 
culated previously and the horizontal response are 
stored in the memory. 

Figure 7a shows a possible memory configura- 
tion used in the consistency check. In the consis- 
tency check it is compared the edge information of 
the sample examined, stored in the memory unit 
54, to the corresponding edge information of neigh- 
bouring samples. The window used in the check is 
here a 5*3 window, so it comprises fifteen 16-bit 
memory units el, e2, .... el 5 described above, 
each of which contains the edge information asso- 
ciated with the pixel. A bit of information in a unit is 
represented in the true/false fashion with one bit. 
This approach does not optimize the memory size 
needed but makes encoding very feasible- The 
size requirement for the memory used In the con- 
sistency check is about 2x720x16 bits. Since there 
is in the window edge information from three suc- 
cessive lines, it is also needed two line memories, 
both comprising 715 pixel delays. In Figure 7b 
there is a magnified illustration of the configuration 
of one memory unit, in this case el 2. It is a 16-bit 
memory comprising bit locations b1, b2, .... b16. 
Above each bit location It Is explained the meaning 
of the location, and the information is represented 
by a 0 or 1 bit (false/true principle). If, for example, 
the check illustrated in Figure 6 has yielded the 
information dir_left = Ieft2, dir_middle = lefti , 
dir_right = rights, dir_totmin = left middle/middle, 
active, then the bits in the memory locations are as 
shown in the figure. 

Figures 8a and 8b show how the preliminary 
direction information Is used for determining the 
interpolation direction in the consistency check. In 
the check it Is used a window the size of which can 
be freely chosen. In this example the size of the 
window Is 5*3 With the window size selection it Is 
possible to slightly weigh the direction in which the 
edge direction will most likely be. The basic idea 
here is to find a dominant direction in a 5*3 window 
by counting the number of main directions, which 
are left, middle, right and horizontal. If the optional 
block C shown in Figure 6 is used, then there are 

also the intermediate directions left ^middle and 

right__mlddle. It should be noted that calculations 
are not performed symmetrically in all fifteen posi- 
tions, but only 1 1 directions are taken into account 
in the counting. For example, when counting the 
number of the left main direction, the edge in- 
formation el. e2. e3. e6. e7. e8. e9, elO. el 3. el 4 
and el 5 are taken into account. In order to be valid 
the edge position must be active (there is no need 



for a special activity bit, but it can be coded so that 
zeros in all directions mean inactive). The total 
number of active positions within the 5x3 region is 
calculated (act count) and half of the act count 
5 specifies the minimum amount required for a main 
direction to be a dominant direction. 

When the main direction in the neighbourhood 
of sample e8 is known, then the subdirection of the 
main direction in this position is set as the inter- 
70 polatlon direction. The default interpolation direc- 
tion is the subdirection (dir middle) of the middle 

main direction. 

In principle, the interpolation direction is now 
known. However, to reduce coupling errors the 
15 consistency of the interpolation direction can be 
further improved as shown in Figure 9. Three suc- 
cessive positions in a line are considered to deter- 
mine the required final interpolation direction for 
the position e8. If the interpolation direction in the 
20 position e8 has been selected from either the left 
or the right main direction and if both e7 and e9 
have been selected from the middle interpolation 
direction, then the selected direction in e8 is not 
consistent and it has to be changed. In this case. 
25 the direction of the position e7 is used. 

With the above-described measures according 
to the invention it has been reliably found out the 
edge direction for each sample of an interlaced 
video signal. This edge information can be used in 
30 many ways when processing the image. If an inter- 
laced video signal complying with the 625/2:1/50 
Hz standard is converted Into a progressive 
625/1 :1/50 Hz signal or into a 625/2:1/100 Hz signal 
with a doubled field frequency or into a 1250/2:1/50 
35 Hz signal, then new lines have to be interpolated. 
There are grounds for performing the line pixel 
Interpolation adaptlvely on the basis of the edge 
information. Then a suitable interpolator would be 
e.g. an interpolator similar to the one shown in 
40 Figure 9 of the Finnish patent no. 89995. This 
interpolator uses samples p3, p4 and p5 from the 
preceding field, see Figure 3a in this application. 
Rgure 10 is a diagrammatic illustration of an FMH- 
type interpolator of said patent application, adapted 
45 to this invention. There it is first calculated the 
averages for the input sample pairs in two-point 
linear filters, and these serve as inputs for three- 
point median filters. There are nine of those, cor- 
responding to nine directions, thus making the in- 
60 terpolation occur in the direction determined by the 
edge Information. 

There is a certain trade-off in directional inter- 
polation: on one hand, If the direction is correctly 
estimated, the interpolation result is good, but, on 
S5 the other hand, if the estimation is erroneous, the 
Interpolation causes visible image errors. The im- 
age errors are typically the more visible the more 
there are direction-based errors in the estimation. 
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Simulations have clearly shown that directional in- 
terpolation in the extrenne directions, such as Ieft4, 
lefts, rights or right4, produces visible image er- 
rors. If the direction has been erroneously es- 
timated to be one of those, the result is that sam- 5 
pies that are not situated in the immediate neigh- 2. 
bourhood of the zero sample X affect considerably 
the value of the zero sample when it is calculated, 
and this makes errors visible in the image. 

70 

Claims 

1. A method for detecting an edge and edge 
direction in an interlaced video signal received 
in the form of sampled data, in which method is 
for each position (X) examined: 

- it is used a detection mask the top row of 
which comprises samples from a line 
(m) and the bottom row comprises sam- 
ples of the corresponding horizontal posi- 20 
tions from the next line (m + 1) of the 
same field, 

- it is calculated several operator re- 
sponses that function in different sub- 
directions with respect to the examined 25 
position (X) in the center of the mask. 

- said operator responses in the subdirec- 
tions are arranged in main groups ac- 
cording to the main directions and for 
each main group it is found out a mini- 
mum response (resp_left, resp middle, 

resp_right) and its subdirection 
(dir_left, dir_middle. dlr_right), which 
is stored in a memory, 

- it is found out the minimum of the mini- 
mum responses and the main direction 

(dir ^totmin) of its main group is stored 

in a memory, 

characterized in that, in addition: 

- for the examined position (X) it is deter- 
mined its activity, and only positions con- 
sidered active are taken into account in 
the consistency check, 

- the operators also include a horizontal 
operator (horizontal), which compares the 
difference of samples In the vertical di- 
rection to the difference of samples in 
the horizontal direction, and the greater 

the difference-in-the vertical direction-and 

the smaller the difference in the horizon- 
tal direction, the greater the probability 
that there is a horizontal edge, 

- it is performed a consistency check, in 
which It is searched the dominant main 
direction of an edge using the main and 55 
subdirection information of the examined 
position PQ and its neighbouring posi- 
tions stored in the memory, and the sub- 
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4. 



6. 



7. 



direction of the minimum response of 
said main direction group of the exam- 
ined position is selected as final edge 
direction. 

The method of claim 1, characterized in that 
the operators, divided into main groups, are: 
middle group: 

vertical = | c3 - clO | + j c4 - c1 1 | 
rightl = | c4 - clO | + | c6 - c11 | 
Ieft1 = |c3-c11 I + |c4-c12| 

left group : : 

Ieft2 = I c2 -c11 j + |c3- 012 I 
lefts = |c2-c12| + |c3-c13| 
Ieft4 = I c1 - c12 I + I c2 - CIS I 

right group : : 

right2 = | c5-c10| + | c6 - c11 | 
rights = | c5 - c9 | + | c6 - clO | 
right4 = I c6 - c9 | + j c7 - c10 | 

where c1, c2, c3. c4, c5, c6 and c7 are the 
samples on the top row of the window and. 
correspondingly. c8. c9. clO. cll. c12, c13 
and c14 are the samples on the bottom row of 
the window. 

The method of claim 2, characterized in that 
the horizontal operator is: horizontal = | c4 - 

cll I - [(max(c3,c4,c5) - min(c3,c4,c5)) + 
(max(c10,c11,c12) - min(c10,c11,c12))]. 

The method of claim 3, characterized in that 
when the horizontal operator . exceeds a set 
first threshold value, there is considered to be 
a horizontal edge. 

The method of claim 1 . characterized in that 
the position examined is determined active if 
any one of the responses of the middle group 
operators is greater than a set second thresh- 
old value. 

The method of claim 1 , characterized in that 

it -wil|-be -performed checks~on" th"e""basis~bf 
which at least one of the main directions is 
discarded as unsuitat>le. 

The method of claims 2 and 6, characterized 
In that in the first check (Check A) it Is com- 
pared the sum of the responses of operators 
Ieft2 and lefti to the sum of the responses of 
operators right2 and rightl , and if the former is 
greater than the latter, the minimum response 
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of the left main direction is discarded, and in 
tlie opposite case the mininnuna response of 
the right main direction is discarded, 

8. The method of claim 7, characterized In that 5 
in the second check (Check B): 

- it is performed a trial Interpolation in the 
direction indicated by the subdirection 
information of the minimum response of 

the remaining main group, io 

- the trial interpolated value (y) is com- 
pared to the sample above and below 
the examined position (X), and if the dif- 
ference falls outside a set range, also the 
minimum response of the remaining is 
main direction is discarded. 

9. The method of any one of the preceding 
claims, characterized in that the consistency 
check is performed in a window, the size of 20 
which has been selected, and to each memory 
position (em) of the window it is associated the 
information on the subdirection of the minimum 
responses of the main groups (dir left, 

dir middle, dir^right), the information on the 25 

minimum of the minimum responses of the 
main groups (dir ^totmin), the activity informa- 
tion (activity), the horizontal response informa- 
tion (horizontal) and the information on whether 
the direction of the minimum of the minimum 30 
responses of the main groups (dir__totmln) is 
in a certain direction. 

10. The method of claim 9. characterized in that 

in the window it is calculated the number of 35 
active positions and how many of each main 
direction there are. and in order for the main 
direction with the greatest number to be the 
dominant main direction said number has to be 
sufficient, e.g. at least half the number of ac- 40 
tive positions. 
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(57) The invention relates to a method for detecting 
an edge and edge direction in an interlaced video signal 
received in the form of a sampled data. In a detection 
mask it is calculated the responses of several operators 
with respect to the examined position (X) in the center of 
the mask, which function in different subdirections. The 
responses are arranged in main groups according to the 
main directions, and for each main group it is found out 
a minimum response and its subcfirectton, after which tt 
is found out the minimum off the minimum responses. In 



addition, for the examined- position (X) it is determined 
its activity. The operators also include a horizontal oper- 
ator. In a consistency check it is found out the dominant 
main direction for the edge using the main and sutxiirec- 
tion information of the examined position (X) and its 
neighbouring positions, stored in memory, and the sub- 
direction of the minimum response of said main direction 
group of the examined positbn is selected as the final 
edge direction. 
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